Skip to content

Add black-box e2e test for start_agent EventHandler action - #1548

Draft
kowser-orkes wants to merge 8 commits into
mainfrom
test/start-agent-blackbox-e2e
Draft

Add black-box e2e test for start_agent EventHandler action#1548
kowser-orkes wants to merge 8 commits into
mainfrom
test/start-agent-blackbox-e2e

Conversation

@kowser-orkes

@kowser-orkes kowser-orkes commented Aug 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Pull Request type

  • Feature
  • Bugfix
  • Refactoring (no functional changes, no api changes)
  • Build related changes
  • WHOSUSING.md
  • Other (please describe):

NOTE: Please remember to run ./gradlew spotlessApply to fix any format violations.

Changes in this PR

  • black-box e2e test suite for the start_agent EventHandler action, against a real running server
  • drives the real trigger → queue → EventHandler → agent-config pipeline, no mocks, no in-process shortcuts
  • covers 3 outcomes off one shared trigger: bogus-model failure, blocked/terminated tool approval, live-LLM completion
                    REST startWorkflow
                            |
                            v
                 +----------------------+
                 | trigger WorkflowDef  |
                 | EVENT task           |
                 | sink: conductor      |
                 +----------------------+
                            |
                            v
                 +----------------------+
                 | conductor queue      |
                 | (QueueDAO, no infra) |
                 +----------------------+
                            |
                            v
                 +----------------------+
                 | shared EventHandler  |
                 | action: start_agent  |
                 +----------------------+
                            |
                            v
                 +-----------------------------+
                 | agent (real agent-config     |
                 | pipeline via AgentClient)    |
                 +-----------------------------+
                    /          |           \
                   v           v            v
              bogus model  prefillTools   live LLM
              -> FAILED    blocked ->     -> COMPLETED
                            TERMINATED
                    \          |           /
                     v         v          v
                 idempotencyKey -> correlationId
                            |
                            v
                 WorkflowClient.getWorkflows(...)

Issue #CCOR-13315

Depends on

  • a conductor-client release containing start_agent — e2e/build.gradle still pins 6.0.0.rc3, does not compile without it or a local workaround

Alternatives considered

  • hand-rolled WorkflowDef-based agent, in-process, no real queue — already covered by a separate existing in-process test
  • LocalStack SQS-backed trigger queue — unnecessary, EVENT task's sink: conductor already routes through the server's own built-in QueueDAO queue
  • unregistered-agent failure path — not black-box-observable, already covered by the existing in-process test

@kowser-orkes
Scaffold EventHandlerStartAgentTests with agent-deploy helpers
2f86f6f 
Ports basicAgentConfig/deployAgent/workerTool from AgentTaskTests.
@kowser-orkes
Register shared trigger workflow and EventHandler for start_agent
86249b9 
e2e now depends on the local :conductor-common module, since no
published conductor-client release includes start_agent yet.
Single EventHandler + EVENT-task workflow reused across all tests to
avoid paying the 60s queue-refresh delay once per test.
@kowser-orkes
Add warm-up loop and fire/await helpers for the shared trigger
e2a094d 
Warm-up repeatedly fires a throwaway agent until the shared
EventHandler's queue is confirmed live, replacing a blind 60s sleep.
Folds stage 5's helpers in early since warm-up depends on fireStartAgent.
@kowser-orkes
Add internal-failure test case for start_agent on the real pipeline
2685b84 
Bogus-model agent deployed via the real pipeline, fired through the
shared EventHandler, found via correlationId, asserted FAILED.
@kowser-orkes
Add cancellation test case for start_agent on the real pipeline
d495861 
Blocking agent (prefillTools + unpolled worker) started through the
shared EventHandler, terminated directly via REST once RUNNING.
@kowser-orkes
Add gated happy-path test for start_agent on the real pipeline
3696240 
Real hello-world agent, live LLM, gated on OPENAI_API_KEY. Reads the
compiled agent's own output.result field for the final answer.
@kowser-orkes
Apply spotless formatting to EventHandlerStartAgentTests
8e1b120
@kowser-orkes
revert
421f5e6
@kowser-orkes kowser-orkes changed the title Test/start agent blackbox e2e Add start_agent EventHandler action support Aug 19, 2026
@kowser-orkes kowser-orkes changed the title Add start_agent EventHandler action support Add black-box e2e test for start_agent EventHandler action Aug 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@kowser-orkes